CN106095111A - The method that virtual reality is mutual is controlled according to user's eye motion - Google Patents
The method that virtual reality is mutual is controlled according to user's eye motion Download PDFInfo
- Publication number
- CN106095111A CN106095111A CN201610474833.0A CN201610474833A CN106095111A CN 106095111 A CN106095111 A CN 106095111A CN 201610474833 A CN201610474833 A CN 201610474833A CN 106095111 A CN106095111 A CN 106095111A
- Authority
- CN
- China
- Prior art keywords
- user
- eye
- mutual
- display system
- virtual reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Abstract
The present invention discloses a kind of method mutual according to user's eye motion control virtual reality, including: it is provided for selecting the time of staying threshold value of the described corresponding pupil performing mutual user's eye corresponding to operation and for judging to trigger the minimum number of winks that described user's eye of execution operation accordingly is interior at a second in the display system that support virtual reality is mutual；Described pupil is detected in the described corresponding time of staying performing interaction area corresponding to operation in described display system, when the described time of staying is up to or over described time of staying threshold value, described corresponding execution is selected to operate the mutual of correspondence, simultaneously, detect described user's eye again one second interior number of winks, described user's eye when one second interior number of winks meets or exceeds described one second interior minimum number of winks, the content of the described corresponding execution operation arranged in triggering described display system.Present invention achieves user's eye motion to the mutual control of virtual reality.
Description
Technical field
The present invention relates to the technical field that intelligent interaction controls, more particularly, to one according to user's eye motion control
The method that virtual reality processed is mutual.
Background technology
Virtual reality technology (Virtual Reality is called for short VR), refers to utilize computer interface to connect connecing in reality
Jaws equipment, and combine that computer graphics system generates on computers can the technology of immersive environment alternately.VR technology utilizes meter
Calculation machine generates interactively Three-Dimensional Dynamic what comes into a driver's and the simulation environment of entity behavior of a kind of Multi-source Information Fusion, with
Make user be immersed in this simulated environment, and user can also be by associative operation and the virtual objects in reality environment
Interact.
At present, VR technology typically by wear-type virtual reality device is worn on head, utilizes virtual reality device to seal
Close user's vision to external world and audition, and guide user to be immersed in simulated environment produced by virtual reality device.Pass through
Virtual reality device realizes the connection with reality environment, and realizes being produced by the button on virtual reality device
The control of reality environment, as realized entering the control that reality environment is mutual by the confirmation button on virtual reality device
Make, realize the regulation etc. to volume by volume button.But, the mode of this interactive operation is as user's false touch
Touch and cause maloperation, so that user has to carry out unnecessary adjustment operation, thus have influence on the experience of user.
In prior art, the basis realizing virtual reality control in video playback is the User Interface at video
Showing setting identification in setting regions, this setting identification district is touched in the reaction of user's view-based access control model to utilize visual pursuit's technology to determine
The virtual reality of this setting regions is triggered by button mutual, when user needs by matching with virtual reality device behind territory
The cooperation of the button on hardware device could perform corresponding virtual interacting, adds the complexity of user operation, and user exists
Differ under double operation and the most ideally carry out the docking of this double operation, thus affect Consumer's Experience.
Therefore it provides a kind of simplicity, fast and exactly realize the method for virtual reality interactive controlling be this area urgently
The problem solved.
Summary of the invention
In view of this, the invention provides a kind of method mutual according to user's eye motion control virtual reality, solve
In prior art can not easy, fast and exactly realize the technical problem of virtual reality interactive controlling.
In order to solve above-mentioned technical problem, the present invention proposes a kind of mutual according to user's eye motion control virtual reality
Method, including:
It is provided for selecting described corresponding execution to operate the mutual of correspondence in the display system that support virtual reality is mutual
User's eye pupil time of staying threshold value and for judging to trigger the corresponding described user's eye of operation that performs at one second
Minimum number of winks in clock；
Described pupil is detected when the stop of the described corresponding interaction area performing operation correspondence in described display system
Between, when the described time of staying is up to or over described time of staying threshold value, select described corresponding execution to operate the mutual of correspondence,
Meanwhile, then detecting described user's eye one second interior number of winks, described user's eye was one second interior number of winks
When meeting or exceeding described one second interior minimum number of winks, the described corresponding execution arranged in triggering described display system
The content of operation.
Further, wherein, it is provided for selecting described corresponding execution in supporting the mutual display system of virtual reality
The time of staying threshold value of the pupil of mutual user's eye that operation is corresponding and corresponding perform the described of operation for judging to trigger
The minimum number of winks that user's eye is interior at one second, be further:
It is provided for selecting described corresponding execution to operate the mutual of correspondence in the display system that support virtual reality is mutual
User's eye pupil time of staying threshold value, for judging to trigger the corresponding described user's eye of operation that performs at one second
In minimum number of winks and for adjusting the pupil of described user's eye of the described corresponding change in value performing operation content
Preset direction that hole is moved and distance.
Further, wherein, in described display system, described pupil is detected in the described corresponding friendship performing operation correspondence
Mutually the time of staying in region, when the described time of staying is up to or over described time of staying threshold value, select described corresponding execution
Corresponding mutual of operation, meanwhile, then detects described user's eye one second interior number of winks, and described user's eye was at one second
When number of winks in clock meets or exceeds described one second interior minimum number of winks, arrange in triggering described display system
Described corresponding execution operation content, be further:
Described pupil is detected when the stop of the described corresponding interaction area performing operation correspondence in described display system
Between, when the described time of staying is up to or over described time of staying threshold value, select described corresponding execution to operate the mutual of correspondence；
Meanwhile,
Detecting described user's eye again one second interior number of winks, described user's eye is in one second interior nictation time
When number meets or exceeds described one second interior minimum number of winks, arrange in triggering described display system described holds accordingly
The content of row operation；Meanwhile,
Pupil further according to user's eye moves the direction of change and described in setting in adjusting described display system
The corresponding change in value performing operation content.
Further, wherein, described time of staying threshold value, is more than or equal to 1000 milliseconds further.
Further, wherein, the described minimum number of winks interior at a second is not less than 2 times.
The present invention also provides for a kind of method mutual according to user's eye motion control virtual reality, including:
It is provided for judging to trigger the corresponding described user performing and operating in the display system that support virtual reality is mutual
The pupil of the eye similarity threshold demarcating movement locus in special time；
In described display system, detect the pupil of the described user's eye movement locus in special time, and calculate institute
Stating the similarity of movement locus and described demarcation movement locus, described movement locus reaches with the similarity of described demarcation movement locus
To or when exceeding described similarity threshold, the content of the described corresponding execution operation arranged in triggering described display system.
Further, wherein, it is provided for judging to trigger corresponding execution in supporting the mutual display system of virtual reality
The pupil of described user's eye of the operation similarity threshold demarcating movement locus in special time, be further:
In the display system that support virtual reality is mutual, it is provided for selection performs operation accordingly for judging to trigger
The pupil of the described user's eye similarity threshold and being used for demarcating movement locus in special time adjusts described to be held accordingly
Preset direction that the pupil of described user's eye of the change in value of row operation content moves and distance.
Further, wherein, in described display system, detect the pupil of the described user's eye fortune in special time
Dynamic track, and calculate the similarity of described movement locus and described demarcation movement locus, described movement locus demarcates fortune with described
When the similarity of dynamic track meets or exceeds described similarity threshold, the described corresponding execution arranged in triggering described display system
The content of operation, be further:
In described display system, detection detects the pupil of described user's eye movement locus in special time, and counts
Calculating the similarity of described movement locus and described demarcation movement locus, described movement locus is similar to described demarcation movement locus
When degree meets or exceeds described similarity threshold, the content of the described corresponding execution operation arranged in triggering described display system,
Meanwhile,
Pupil further according to user's eye moves the direction of change and described in setting in adjusting described display system
The corresponding change in value performing operation content.
Further, wherein, described special time, is less than or equal to 3 seconds further.
Further, wherein, described similarity threshold, is more than or equal to 80% further.
Compared with prior art, the method mutual according to user's eye motion control virtual reality of the present invention, it is achieved that
Following beneficial effect:
(1) method mutual according to user's eye motion control virtual reality of the present invention, watches video user
Trigger the virtual reality on video content mutual time, utilize the user's number of winks reaching predetermined condition to control to trigger virtual reality
Alternately, it is not necessary to based on the hardware button on virtual unit, the most permissible according only to user's eye motion in viewing video
Realize corresponding virtual reality interactive controlling, it is to avoid user needs to combine the numerous and diverse of button operation in virtual reality is mutual
Property, improve Consumer's Experience.
(2) method mutual according to user's eye motion control virtual reality of the present invention, when user watches video
After virtual reality is mutual on selection video content, control to trigger this when meeting predetermined condition in conjunction with the eye action following the trail of user virtual
Reality mutual, it is ensured that trigger virtual reality according to user intention exactly mutual, it is to avoid user false touch because of maloperation
Send out the generation that virtual reality is mutual.
(3) method mutual according to user's eye motion control virtual reality of the present invention, watches video user
Time trigger the content of the described corresponding execution operation arranged in described display system, simultaneously further according to the direction of user's eye motion
Adjust the change in value in the described corresponding content performing operation, it is achieved that by user's eye motion to change in value
The corresponding control performing operation.
Certainly, the arbitrary product implementing the present invention specific needs must not reach all the above technique effect simultaneously.
By detailed description to the exemplary embodiment of the present invention referring to the drawings, the further feature of the present invention and
Advantage will be made apparent from.
Accompanying drawing explanation
Combined in the description and the accompanying drawing of the part that constitutes description shows embodiments of the invention, and even
With its explanation together for explaining the principle of the present invention.
Fig. 1 is the flow process controlling the mutual method of virtual reality according to user's eye motion described in the embodiment of the present invention 1
Schematic diagram；
Fig. 2 A is user in the method mutual according to user's eye motion control virtual reality described in the embodiment of the present invention 1
The view opened eyes during nictation；
Fig. 2 B is user in the method mutual according to user's eye motion control virtual reality described in the embodiment of the present invention 1
The view closed one's eyes during nictation；
Fig. 3 is the flow process controlling the mutual method of virtual reality according to user's eye motion described in the embodiment of the present invention 2
Schematic diagram；
Fig. 4 A is that in inventive embodiments 2, after selecting corresponding execution operation correspondence mutual, described corresponding execution of triggering operates
The structural representation of content；
Fig. 4 B is to trigger and adjust described corresponding execution after selecting corresponding execution operation correspondence mutual in inventive embodiments 2
The structural representation of change in value in the content of operation；
Fig. 5 is the flow process controlling the mutual method of virtual reality according to user's eye motion described in the embodiment of the present invention 3
Schematic diagram；
Fig. 6 is user in the method mutual according to user's eye motion control virtual reality described in the embodiment of the present invention 3
The schematic diagram of the track that the pupil of eye moves a week up and down；
Fig. 7 is the flow process controlling the mutual method of virtual reality according to user's eye motion described in the embodiment of the present invention 4
Schematic diagram.
Detailed description of the invention
The various exemplary embodiments of the present invention are described in detail now with reference to accompanying drawing.It should also be noted that unless additionally have
Body illustrates, the parts illustrated the most in these embodiments and positioned opposite, the numerical expression of step and numerical value are not intended to this
The scope of invention.
Description only actually at least one exemplary embodiment is illustrative below, never as to the present invention
And any restriction applied or use.
May be not discussed in detail for technology, method and apparatus known to person of ordinary skill in the relevant, but suitable
In the case of when, described technology, method and apparatus should be considered a part for description.
It is shown here that any occurrence should be construed as merely exemplary with in all examples discussed, and not
It is as restriction.Therefore, other example of exemplary embodiment can have different values.
It should also be noted that similar label and letter represent similar terms, therefore, the most a certain Xiang Yi in following accompanying drawing
Individual accompanying drawing is defined, then need not it is further discussed in accompanying drawing subsequently.
Embodiment 1
As it is shown in figure 1, for the stream controlling the mutual method of virtual reality according to user's eye motion described in the present embodiment
Journey schematic diagram, it is achieved that utilize user's eye motion to control virtual reality mutual.Moving according to user's eye described in the present embodiment
The method making to control virtual reality mutual comprises the following steps:
Step 101, in supporting the mutual display system of virtual reality, it is provided for selecting that described corresponding to perform operation right
The time of staying threshold value of the pupil of the mutual user's eye answered and trigger the corresponding described user's eye performing operation for judging
The minimum number of winks that portion is interior at one second.
Can be by detection user's eye motion such as sensors in the display system that support virtual reality is mutual, including inspection
Survey described user's eye pupillomotor direction and distance and the time of staying etc. of described pupil, pre-set for judging
The decision condition triggering the corresponding user's eye motion performing operation is conducive to described display system according to the user's eye detected
Portion's action determines whether to trigger and described corresponding performs operation.
The action of eye is controlled when step 102, user are by playing the equipment of video and watching video.
Step 103, in described display system, detect described pupil corresponding perform the interaction area that operation is corresponding described
The time of staying, and judge that whether the described time of staying is up to or over described time of staying threshold value.
When step 104, the described time of staying are up to or over described time of staying threshold value, select described corresponding to perform behaviour
Make the mutual of correspondence.
Alternatively, arrange in described display system arrive described time threshold prompting in case remind user.
Step 105, select described corresponding to perform corresponding mutual of operation, meanwhile, then detect described user's eye at one second
Number of winks in clock.
Step 106, judge whether described user's eye goes out to meet or exceed described one second one second interior number of winks
Minimum described number of winks in clock.
Step 107, meet or exceed described one second interior minimum institute when the described number of winks of described user's eye
When stating number of winks, the content of the described corresponding execution operation arranged in triggering described display system.
Step 108, when described nictation time of described user's eye is less than described one second interior minimum described nictation time
During number, the content of the described corresponding execution operation arranged in not triggering described display system.
The action of user's nictation is described in conjunction with Fig. 2 A and Fig. 2 B, and as shown in Figure 2 A, the state opened eyes when blinking for user is shown
Being intended to, wherein 201 be the pupil of user's eye, and Fig. 2 B is user's view of eye closing when blinking.
In the present embodiment, utilize user's number of winks in the given time whether to meet predetermined condition to control to trigger void
Intend reality mutual, it is not necessary to based on the hardware button on virtual unit, according only to user's eye motion in viewing video
Just can realize the virtual reality interactive controlling of correspondence, it is to avoid user needs to combine button operation in virtual reality is mutual
Complex, improves Consumer's Experience.
Embodiment 2
As it is shown on figure 3, for the stream controlling the mutual method of virtual reality according to user's eye motion described in the present embodiment
Journey schematic diagram, the present embodiment illustrates that on the basis of embodiment 1 user's eye motion controls in mutual concrete of virtual reality
Hold.The step of the method mutual according to user's eye motion control virtual reality described in the present embodiment is as follows:
Step 301, in supporting the mutual display system of virtual reality, it is provided for selecting that described corresponding to perform operation right
The time of staying threshold value of the pupil of the mutual user's eye answered, trigger the corresponding described user's eye performing operation for judging
The minimum number of winks interior at one second and for adjusting the described corresponding described user of change in value performing operation content
Preset direction that the pupil of eye moves and distance.Described time of staying threshold value, is more than or equal to 1000 milliseconds further；Institute
State the minimum number of winks interior at a second not less than 2 times.
The action of eye is controlled when step 302, user are by playing the equipment of video and watching video.
Step 303, in described display system, detect described pupil corresponding perform the interaction area that operation is corresponding described
The time of staying, and judge that whether the described time of staying is up to or over described time of staying threshold value.
Step 304, when the described time of staying up to or over the described time of staying threshold value time, select described corresponding execution
Operate the mutual of correspondence.
Step 305, select described corresponding to perform corresponding mutual of operation, meanwhile, then detect described user's eye at one second
Number of winks in clock, and judge whether described user's eye meets or exceeds described one second one second interior number of winks
In minimum number of winks time, the content of the described corresponding execution operation arranged in triggering described display system.
Step 306, described user's eye one second interior number of winks meet or exceed described one second interior minimum
Number of winks time, trigger the content of the described corresponding execution operation arranged in described display system.Wherein, described corresponding execution
The window context of operation includes: trigger the mutual confirmation of virtual reality, the beginning/tentative of video, video F.F./retrogressing with
And the increase/reduction of video/audio.
In illustrating to trigger described display system in the present embodiment in conjunction with Fig. 4 A and Fig. 4 B, the described corresponding of setting performs operation
The process of content.Wherein, the described corresponding execution of triggering after selecting corresponding execution operation correspondence mutual during Fig. 4 A is the present embodiment
The structural representation of the content of operation；Fig. 4 B is to select in the present embodiment to trigger and adjust institute after execution operation correspondence is mutual accordingly
State the structural representation of change in value in the corresponding content performing operation.Basis in the viewing area 401 of described display system
User triggers the described corresponding content 402 performing operation when meeting predetermined condition nictation, meanwhile, user is transported by the pupil of eye
Dynamic control is moved on the numerical control bar 403 numerical value bar 404 in the described corresponding content 402 performing operation, described display system
System performs corresponding operation according to the numerical value that the numerical value position that described numerical control bar 403 moves to reach is corresponding.
Step 307, described user's eye are not up to interior minimum blinking in described a second one second interior number of winks
During eye number of times, the content of the described corresponding execution operation arranged in not triggering described display system.
Step 308, trigger the content of the described corresponding execution operation arranged in described display system, meanwhile, then detect institute
The pupil stating user's eye moves direction and the distance of change.
Step 309, pupil according to user's eye move the direction of change and distance adjust described display system in arrange
Described corresponding execution operation content change in value.Alternatively, the change of described correlation values may be used for the base of player
This is mutual: playing progress rate and the regulation of volume；The change of described correlation values can be also used for and play content and scene is relevant
Mutual, the position correlation values change of object in the pupil mobile control operation content correspondence scene of such as eye.
Alternatively, step 308 and step 309 include: trigger the increase of the F.F./retrogressing of video and video/audio/
Reduce hold operation while, further according to pupillomotor direction (can be up and down or left and right directions) and the distance of user's eye
Adjust the F.F./retrogressing of video and the change in value of the increase/reduction of video/audio.
The described number of winks of described user's eye meets or exceeds described one second interior minimum described number of winks
Time, the content of the described corresponding execution operation arranged in triggering described display system.
During the described number of winks of minimum interior less than described a second described nictation of described user's eye time, do not trigger
The content of the described corresponding execution operation arranged in described display system.
Alternatively, in above-mentioned steps 306, it is also possible to be set to reach one second interior number of winks when user's eye or
When exceeding described one second interior minimum number of winks, trigger after the described corresponding window context performing operation ejects.
Further according to user's eye pupillomotor direction adjust described corresponding perform operation window context in really
Recognize mark shift position.
In described display system, judge whether described confirmation mark present position moves to described corresponding execution operation
Subordinate in window context performs operating window content, and judges whether user's eye motion met in one second interior nictation time
Number meets or exceeds the condition of described one second interior minimum number of winks, and performs according to judged result in the form of operation
Subordinate in appearance performs operating window, triggers described subordinate and performs the ejection of operating window content.Described in the present embodiment according to
Family eye motion controls the method that virtual reality is mutual, after when user watches video, on triggering video content, virtual reality is mutual,
Determine whether to trigger the mutual of this virtual reality in conjunction with according to the confirmation operation of the eye action following the trail of user, it is ensured that press exactly
Virtual reality is triggered mutual, it is to avoid the user generation that false triggering virtual reality is mutual because of maloperation according to user intention.With
The window context triggering the described corresponding execution operation arranged in described display system during the viewing video of family ejects, simultaneously further according to
The direction of user's eye motion adjusts the confirmation mark shift position in the described corresponding window context performing operation, it is achieved that
By the control to multistage window context of user's eye motion.
Embodiment 3
As it is shown in figure 5, for the flow process controlling the mutual method of virtual reality according to user's eye motion described in this enforcement
Schematic diagram.The method combines the pupil movement track of user's eye and judges that triggering virtual reality is mutual.Root described in the present embodiment
The method controlling virtual reality mutual according to user's eye motion comprises the steps:
Step 501, it is provided for judging in supporting the mutual display system of virtual reality triggering and corresponding performs operation
The pupil of the described user's eye similarity threshold demarcating movement locus in special time.
Can be by detection user's eye motion such as sensors in the display system that support virtual reality is mutual, including inspection
Survey described user's eye pupillomotor direction and distance and the time of staying etc. of described pupil, pre-set for judging
Trigger decision condition (the similarity threshold demarcating movement locus in special time of the corresponding user's eye motion performing operation
Value) be conducive to described display system to determine whether to trigger according to the user's eye motion detected and described corresponding perform operation.
The action of eye is controlled when step 502, user are by playing the equipment of video and watching video, including: the pupil of eye
Move in hole.
Step 503, in described display system, detect the pupil of the described user's eye movement locus in special time,
And calculate the similarity of described movement locus and described demarcation movement locus.
Step 504, to judge whether the similarity of described movement locus and described demarcation movement locus meets or exceeds described
Similarity threshold.
Step 505, meet or exceed described similarity when the similarity of described movement locus Yu described demarcation movement locus
During threshold value, the content of the described corresponding execution operation arranged in triggering described display system.
Step 506, described movement locus not up to or exceed described similarity with the similarity of described demarcation movement locus
During threshold value, the content of the described corresponding execution operation arranged in not triggering described display system.
In above-mentioned steps, described demarcation movement locus can be the track that user's pupil moves up and down a week.Institute
State and combine the track schematic diagram that Fig. 6 illustrates that the pupil of user's eye moves a week up and down, described in eye centre position
Pupil 601 is through moving up and down the pupil 603 of the position respectively obtaining the pupil 602 of eyes upper position, right part, bottom
The pupil 604 of position and the movement locus 606 of pupil 605 of position of left part.
In the present embodiment, utilize the pupil of the user's eye movement locus within the nominal time pre-set the fullest
It is mutual that foot predetermined condition controls to trigger virtual reality, it is not necessary to based on the hardware button on virtual unit, according only to user
Eye motion in viewing video just can realize the virtual reality interactive controlling of correspondence, it is to avoid user is in virtual reality friendship
Need to combine the complex of button operation in Hu, improve Consumer's Experience.
Embodiment 4
As it is shown in fig. 7, for the stream controlling the mutual method of virtual reality according to user's eye motion described in the present embodiment
Journey schematic diagram, the present embodiment illustrates that on the basis of embodiment 3 user's eye motion controls in mutual concrete of virtual reality
Hold.The step of the method mutual according to user's eye motion control virtual reality described in the present embodiment is as follows:
Step 701, it is provided for judging in supporting the mutual display system of virtual reality triggering and corresponding performs operation
The pupil of the described user's eye similarity threshold and being used for demarcating movement locus in special time adjusts described to be held accordingly
Preset direction that the pupil of described user's eye of the change in value of row operation content moves and distance.Described special time, enters
One step is less than or equal to 3 seconds；Described similarity threshold, is more than or equal to 80% further.
The action of eye is controlled when step 702, user are by playing the equipment of video and watching video, including: the pupil of eye
Move in hole.
Step 703, in described display system, detect the pupil of the described user's eye movement locus in special time,
And calculate the similarity of described movement locus and described demarcation movement locus, it is judged that described movement locus and described demarcation campaign rail
Whether the similarity of mark meets or exceeds described similarity threshold.
Step 704, meet or exceed described similarity when the similarity of described movement locus Yu described demarcation movement locus
During threshold value, the content of the described corresponding execution operation arranged in triggering described display system.
In illustrating to trigger described display system in the present embodiment in conjunction with Fig. 4 A and Fig. 4 B, the described corresponding of setting performs operation
The process of content.Wherein, the described corresponding execution of triggering after selecting corresponding execution operation correspondence mutual during Fig. 4 A is the present embodiment
The structural representation of the content of operation；Fig. 4 B is to select in the present embodiment to trigger and adjust institute after execution operation correspondence is mutual accordingly
State the structural representation of change in value in the corresponding content performing operation.Basis in the viewing area 401 of described display system
The pupillomotor track of user's eye triggers the described corresponding content 402 performing operation, meanwhile, user when meeting predetermined condition
Controlled on the numerical control bar 403 numerical value bar 404 in the described corresponding content 402 performing operation by the pupil movement of eye
Mobile, numerical value corresponding to numerical value position that described display system moves to reach according to described numerical control bar 403 performs corresponding
Operation.
Step 705, described movement locus not up to or exceed described similarity with the similarity of described demarcation movement locus
During threshold value, the content of the described corresponding execution operation arranged in not triggering described display system.
Step 706, trigger the content of the described corresponding execution operation arranged in described display system, meanwhile, then detect institute
The pupil stating user's eye moves direction and the distance of change.
Step 707, pupil according to described user's eye move the direction of change and distance adjusts in described display system
The change in value of the described corresponding execution operation content arranged.
Alternatively, in above-mentioned steps 705, it is also possible to be set to when the phase of described movement locus with described demarcation movement locus
When meeting or exceeding described similarity threshold like degree, after triggering the described corresponding window context ejection performing operation.
Further according to user's eye pupillomotor direction adjust described corresponding perform operation window context in really
Recognize mark shift position.
In described display system, judge whether described confirmation mark present position moves to described corresponding execution operation
Subordinate in window context performs operating window content, and judges that user is when described movement locus and described demarcation movement locus
Similarity meets or exceeds condition during described similarity threshold, and under performing according to judged result in the window context of operation
Level performs operating window, triggers described subordinate and performs the ejection of operating window content.
The method mutual according to user's eye motion control virtual reality described in the present embodiment, user touches when watching video
Send out after virtual reality is mutual on video content, combine the confirmation according to the eye action following the trail of user and operate and determine whether to trigger this void
Intend the mutual of reality, it is ensured that trigger virtual reality according to user intention exactly mutual, it is to avoid user is mistake because of maloperation
Trigger the generation that virtual reality is mutual.Trigger described display system when user watches video in, the described corresponding of setting performs behaviour
The window context made ejects, and the direction further according to user's eye motion adjusts at the described corresponding window context performing operation simultaneously
In confirmation mark shift position, it is achieved that by the control to multistage window context of user's eye motion.
Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, device or computer program
Product.Therefore, the reality in terms of the present invention can use complete hardware embodiment, complete software implementation or combine software and hardware
Execute the form of example.And, the present invention can use at one or more computers wherein including computer usable program code
The upper computer program product implemented of usable storage medium (including but not limited to disk memory, CD-ROM, optical memory etc.)
The form of product.
Although by example, some specific embodiments of the present invention have been described in detail, but the skill of this area
Art personnel are it should be understood that example above is merely to illustrate rather than in order to limit the scope of the present invention.The skill of this area
Art personnel are it should be understood that can modify to above example without departing from the scope and spirit of the present invention.This
Bright scope is defined by the following claims.
Claims (10)
1. one kind controls the mutual method of virtual reality according to user's eye motion, it is characterised in that including:
It is provided for selecting the described corresponding mutual use performing operation correspondence in the display system that support virtual reality is mutual
The time of staying threshold value of the pupil of family eye and trigger the corresponding described user's eye of operation that performs in one second for judging
Minimum number of winks；
Described pupil is detected in the described corresponding time of staying performing interaction area corresponding to operation, institute in described display system
State the time of staying up to or over the described time of staying threshold value time, select described corresponding corresponding mutual of operation that perform, meanwhile,
Detect described user's eye again one second interior number of winks, described user's eye reach one second interior number of winks or
When exceeding described one second interior minimum number of winks, the described corresponding execution operation arranged in triggering described display system
Content.
The method mutual according to user's eye motion control virtual reality the most according to claim 1, it is characterised in that
It is provided in the display system that support virtual reality is mutual selecting the described corresponding mutual user's eye performing operation correspondence
Pupil time of staying threshold value and for judging to trigger minimum interior at a second of the corresponding described user's eye performing operation
Number of winks, be further:
It is provided for selecting the described corresponding mutual use performing operation correspondence in the display system that support virtual reality is mutual
The time of staying threshold value of the pupil of family eye, interior at one second for judging to trigger the corresponding described user's eye performing operation
Minimum number of winks and for adjust described corresponding perform operation content change in value described user's eye pupil move
Dynamic preset direction and distance.
The method mutual according to user's eye motion control virtual reality the most according to claim 2, it is characterised in that
Described pupil is detected in the described corresponding time of staying performing interaction area corresponding to operation, described stop in described display system
When time is up to or over described time of staying threshold value, selects described corresponding execution to operate the mutual of correspondence, then detect meanwhile
Described user's eye meets or exceeds institute at one second interior number of winks, described user's eye one second interior number of winks
When stating one second interior minimum number of winks, the content of the described corresponding execution operation arranged in triggering described display system,
It is further:
Described pupil is detected in the described corresponding time of staying performing interaction area corresponding to operation, institute in described display system
State the time of staying up to or over the described time of staying threshold value time, select described corresponding to perform corresponding mutual of operation；Meanwhile,
Detect described user's eye again to reach one second interior number of winks at one second interior number of winks, described user's eye
To or when exceeding described one second interior minimum number of winks, arrange in triggering described display system described corresponding performs behaviour
The content made；Meanwhile,
Move the direction of change further according to the pupil of user's eye and distance adjust described display system in arrange described accordingly
Perform the change in value of operation content.
The method mutual according to user's eye motion control virtual reality the most according to claim 1, it is characterised in that institute
State time of staying threshold value, be more than or equal to 1000 milliseconds further.
The method mutual according to user's eye motion control virtual reality the most according to claim 1, it is characterised in that institute
State the minimum number of winks interior at a second not less than 2 times.
6. one kind controls the mutual method of virtual reality according to user's eye motion, it is characterised in that including:
It is provided for judging to trigger the corresponding described user's eye performing and operating in the display system that support virtual reality is mutual
Pupil in special time demarcate movement locus similarity threshold；
In described display system, detect the pupil of the described user's eye movement locus in special time, and calculate described fortune
The similarity of dynamic track and described demarcation movement locus, the similarity of described movement locus and described demarcation movement locus reach or
When exceeding described similarity threshold, the content of the described corresponding execution operation arranged in triggering described display system.
The method mutual according to user's eye motion control virtual reality the most according to claim 6, it is characterised in that
The pupil judging to trigger the corresponding described user's eye performing and operating it is provided in the display system that support virtual reality is mutual
The similarity threshold demarcating movement locus in special time, be further:
It is provided for selecting for judging to trigger described in execution operation accordingly in the display system that support virtual reality is mutual
The pupil of the user's eye similarity threshold and being used for demarcating movement locus in special time adjusts and described corresponding performs behaviour
Preset direction that the pupil of the described user's eye making the change in value of content moves and distance.
The method mutual according to user's eye motion control virtual reality the most according to claim 7, it is characterised in that
The pupil of the described user's eye of detection movement locus in special time in described display system, and calculate described movement locus
With the similarity of described demarcation movement locus, described movement locus meets or exceeds institute with the similarity of described demarcation movement locus
When stating similarity threshold, the content of the described corresponding execution operation arranged in triggering described display system, be further:
In described display system, detection detects the pupil of described user's eye movement locus in special time, and calculates institute
Stating the similarity of movement locus and described demarcation movement locus, described movement locus reaches with the similarity of described demarcation movement locus
To or when exceeding described similarity threshold, the content of the described corresponding execution operation arranged in triggering described display system, meanwhile,
Move the direction of change further according to the pupil of user's eye and distance adjust described display system in arrange described accordingly
Perform the change in value of operation content.
The method mutual according to user's eye motion control virtual reality the most according to claim 6, it is characterised in that institute
State special time, be less than or equal to 3 seconds further.
The method mutual according to user's eye motion control virtual reality the most according to claim 6, it is characterised in that
Described similarity threshold, is more than or equal to 80% further.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610474833.0A CN106095111A (en) | 2016-06-24 | 2016-06-24 | The method that virtual reality is mutual is controlled according to user's eye motion |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610474833.0A CN106095111A (en) | 2016-06-24 | 2016-06-24 | The method that virtual reality is mutual is controlled according to user's eye motion |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106095111A true CN106095111A (en) | 2016-11-09 |
Family
ID=57252899
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610474833.0A Pending CN106095111A (en) | 2016-06-24 | 2016-06-24 | The method that virtual reality is mutual is controlled according to user's eye motion |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106095111A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106681514A (en) * | 2017-01-11 | 2017-05-17 | 广东小天才科技有限公司 | Virtual reality device and implementation method thereof |
| CN106682117A (en) * | 2016-12-07 | 2017-05-17 | 深圳市豆娱科技有限公司 | Browser operating method and device |
| CN106774928A (en) * | 2016-12-30 | 2017-05-31 | 维沃移动通信有限公司 | The data processing method and virtual reality terminal of a kind of virtual reality terminal |
| CN107015854A (en) * | 2017-02-28 | 2017-08-04 | 阿里巴巴集团控股有限公司 | The control method and device of physical characteristics collecting hardware |
| CN107045201A (en) * | 2016-12-27 | 2017-08-15 | 上海与德信息技术有限公司 | A kind of display methods and system based on VR devices |
| CN107046663A (en) * | 2017-02-06 | 2017-08-15 | 北京安云世纪科技有限公司 | A kind of player method of stereophone, device and VR equipment |
| CN107831890A (en) * | 2017-10-11 | 2018-03-23 | 北京华捷艾米科技有限公司 | Man-machine interaction method, device and equipment based on AR |
| WO2018090472A1 (en) * | 2016-11-15 | 2018-05-24 | 歌尔科技有限公司 | Method and system for selecting seat employing virtual reality technology, and virtual reality head-mounted device |
| CN108132711A (en) * | 2018-01-11 | 2018-06-08 | 广东小天才科技有限公司 | A kind of playing progress bar control method and electronic equipment |
| CN108536277A (en) * | 2017-03-06 | 2018-09-14 | 北京可见文化传播有限公司 | The method and system of the interactive elements unrelated with picture are activated in VR environment |
| CN109634427A (en) * | 2018-12-24 | 2019-04-16 | 陕西圆周率文教科技有限公司 | AR glasses control system and control method based on head-tracking |
| CN110362191A (en) * | 2018-04-09 | 2019-10-22 | 北京松果电子有限公司 | Target selecting method, device, electronic equipment and storage medium |
| CN111586459A (en) * | 2020-05-22 | 2020-08-25 | 北京百度网讯科技有限公司 | Method and device for controlling video playing, electronic equipment and storage medium |
| CN114939272A (en) * | 2022-06-15 | 2022-08-26 | 广州汽车集团股份有限公司 | Vehicle-mounted interactive game method and system based on HUD |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102292690A (en) * | 2009-01-22 | 2011-12-21 | 阿尔卡特朗讯美国公司 | Electronic data input system |
| CN102981616A (en) * | 2012-11-06 | 2013-03-20 | 中兴通讯股份有限公司 | Identification method and identification system and computer capable of enhancing reality objects |
| CN105138118A (en) * | 2015-07-31 | 2015-12-09 | 努比亚技术有限公司 | Intelligent glasses, method and mobile terminal for implementing human-computer interaction |
| CN105549732A (en) * | 2015-12-03 | 2016-05-04 | 小米科技有限责任公司 | Method and device for controlling virtual reality device and virtual reality device |
-
2016
- 2016-06-24 CN CN201610474833.0A patent/CN106095111A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102292690A (en) * | 2009-01-22 | 2011-12-21 | 阿尔卡特朗讯美国公司 | Electronic data input system |
| CN102981616A (en) * | 2012-11-06 | 2013-03-20 | 中兴通讯股份有限公司 | Identification method and identification system and computer capable of enhancing reality objects |
| CN105138118A (en) * | 2015-07-31 | 2015-12-09 | 努比亚技术有限公司 | Intelligent glasses, method and mobile terminal for implementing human-computer interaction |
| CN105549732A (en) * | 2015-12-03 | 2016-05-04 | 小米科技有限责任公司 | Method and device for controlling virtual reality device and virtual reality device |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018090472A1 (en) * | 2016-11-15 | 2018-05-24 | 歌尔科技有限公司 | Method and system for selecting seat employing virtual reality technology, and virtual reality head-mounted device |
| CN106682117A (en) * | 2016-12-07 | 2017-05-17 | 深圳市豆娱科技有限公司 | Browser operating method and device |
| CN107045201A (en) * | 2016-12-27 | 2017-08-15 | 上海与德信息技术有限公司 | A kind of display methods and system based on VR devices |
| CN107045201B (en) * | 2016-12-27 | 2019-09-06 | 上海与德信息技术有限公司 | A kind of display methods and system based on VR device |
| CN106774928A (en) * | 2016-12-30 | 2017-05-31 | 维沃移动通信有限公司 | The data processing method and virtual reality terminal of a kind of virtual reality terminal |
| CN106681514A (en) * | 2017-01-11 | 2017-05-17 | 广东小天才科技有限公司 | Virtual reality device and implementation method thereof |
| CN107046663B (en) * | 2017-02-06 | 2019-11-05 | 北京安云世纪科技有限公司 | A kind of playback method of stereophone, device and VR equipment |
| CN107046663A (en) * | 2017-02-06 | 2017-08-15 | 北京安云世纪科技有限公司 | A kind of player method of stereophone, device and VR equipment |
| CN107015854A (en) * | 2017-02-28 | 2017-08-04 | 阿里巴巴集团控股有限公司 | The control method and device of physical characteristics collecting hardware |
| CN107015854B (en) * | 2017-02-28 | 2020-10-30 | 创新先进技术有限公司 | Control method and device of biological characteristic acquisition hardware |
| CN108536277A (en) * | 2017-03-06 | 2018-09-14 | 北京可见文化传播有限公司 | The method and system of the interactive elements unrelated with picture are activated in VR environment |
| CN107831890A (en) * | 2017-10-11 | 2018-03-23 | 北京华捷艾米科技有限公司 | Man-machine interaction method, device and equipment based on AR |
| CN108132711A (en) * | 2018-01-11 | 2018-06-08 | 广东小天才科技有限公司 | A kind of playing progress bar control method and electronic equipment |
| CN110362191A (en) * | 2018-04-09 | 2019-10-22 | 北京松果电子有限公司 | Target selecting method, device, electronic equipment and storage medium |
| CN109634427A (en) * | 2018-12-24 | 2019-04-16 | 陕西圆周率文教科技有限公司 | AR glasses control system and control method based on head-tracking |
| CN109634427B (en) * | 2018-12-24 | 2022-06-14 | 陕西圆周率文教科技有限公司 | AR (augmented reality) glasses control system and control method based on head tracking |
| CN111586459A (en) * | 2020-05-22 | 2020-08-25 | 北京百度网讯科技有限公司 | Method and device for controlling video playing, electronic equipment and storage medium |
| CN114939272A (en) * | 2022-06-15 | 2022-08-26 | 广州汽车集团股份有限公司 | Vehicle-mounted interactive game method and system based on HUD |
| CN114939272B (en) * | 2022-06-15 | 2023-08-04 | 广州汽车集团股份有限公司 | Vehicle-mounted interactive game method and system based on HUD |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106095111A (en) | The method that virtual reality is mutual is controlled according to user's eye motion | |
| CN106200899A (en) | The method and system that virtual reality is mutual are controlled according to user's headwork | |
| US10438393B2 (en) | Virtual reality presentation of body postures of avatars | |
| US20170038837A1 (en) | Hover behavior for gaze interactions in virtual reality | |
| CN106125921B (en) | Gaze detection in 3D map environment | |
| US9829988B2 (en) | Three dimensional user interface session control using depth sensors | |
| US20120313848A1 (en) | Three Dimensional User Interface Session Control | |
| US11809637B2 (en) | Method and device for adjusting the control-display gain of a gesture controlled electronic device | |
| JP6455310B2 (en) | Motion estimation device, robot, and motion estimation method | |
| EP2362325A2 (en) | Systems and methods for motion recognition using multiple sensing streams | |
| CN105824409A (en) | Interactive control method and device for virtual reality | |
| KR101906633B1 (en) | Apparatus and method for providing haptic on vitrual video | |
| CN105955461A (en) | Interactive interface management method and system | |
| CN103246351A (en) | User interaction system and method | |
| CA2923436A1 (en) | Systems and methods for providing response to user input using information about state changes and predicting future user input | |
| US20140317577A1 (en) | Gesture controllable system uses proprioception to create absolute frame of reference | |
| AU2010366331A1 (en) | User interface, apparatus and method for gesture recognition | |
| CN103631365B (en) | A kind of terminal input control method and device | |
| US20150234567A1 (en) | Information processing apparatus, information processing method and computer program | |
| US20170124762A1 (en) | Virtual reality method and system for text manipulation | |
| CN106393113A (en) | Robot and interactive control method for robot | |
| US20210042526A1 (en) | Information processing apparatus, information processing method, and recording medium | |
| CN106774833A (en) | Virtual reality exchange method and device | |
| CN109324686B (en) | Slide block operation method based on sight tracking | |
| KR101525011B1 (en) | tangible virtual reality display control device based on NUI, and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161109 |