CN105892632A - Method and device for judging the selection of UI (User Interface) widgets of virtual reality application - Google Patents
Method and device for judging the selection of UI (User Interface) widgets of virtual reality application Download PDFInfo
- Publication number
- CN105892632A CN105892632A CN201510785543.3A CN201510785543A CN105892632A CN 105892632 A CN105892632 A CN 105892632A CN 201510785543 A CN201510785543 A CN 201510785543A CN 105892632 A CN105892632 A CN 105892632A
- Authority
- CN
- China
- Prior art keywords
- control
- human eye
- eye sight
- bounding box
- virtual reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Navigation (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention puts forward a method and a device for judging the selection of the UI (User Interface) widgets of a virtual reality application. The method comprises the following steps: S001) obtaining a human eye sight line; and S002) if the human eye sight line intersects with a bounding box used for containing a plurality of UI widgets, calculating the intersection position of the human eye sight line in the bounding box, taking the UI widget on the intersection position as a selected UI widget, and executing a selected event corresponding to the selected UI widget. The device comprises a human eye acquisition module and a judgment and execution module. Through a way that the plurality of UI widgets are put into the same bounding box and then the selected UI widget in the bounding box is judged according to the intersection position of the human eye sight line and the bounding box, the problem in the prior art that each UI widget needs to create one bounding box is solved.
Description
Technical field
The present invention relates to the field of virtual reality applications, particularly relate to one and judge virtual reality applications
The selected method and apparatus of UI control.
Background technology
In prior art, 3D UI control (the 3D User that virtual reality (VR) based on mobile phone is applied
Interface Widget) ray pickup (Ray Casting) scheme in, all use bounding box
Collision detection algorithm, this algorithm is according to human eye sight and the bag at each UI control place in three dimensions
Enclosing box, whether to there is intersection point the most selected to detect control.The defect that this algorithm exists is each
UI control is required for building a bounding box, makes the vertex number mistake of bounding box in virtual reality scenario
Many, reduce rendering efficiency.
Therefore, it is necessary to the method proposing to improve drawbacks described above.
Summary of the invention
Based on problem above, the present invention proposes a kind of to judge that the UI control of virtual reality applications is selected
Method, by multiple UI controls are put in same bounding box then according to human eye sight with
The intersection location of bounding box judges that the mode of UI control selected in bounding box solves prior art
In each UI control need a bounding box problem.
On the one hand, the present invention proposes a kind of method that UI control judging virtual reality applications is selected,
Including: step S001, obtain human eye sight；Step S002, if described human eye sight be used for containing
The bounding box putting multiple described UI control intersects, then calculate described human eye sight in described bounding box
Intersection location, using the UI control of described intersection location as selected UI control, perform described quilt
UI control is selected to choose event accordingly.
Preferably, the gyroscope by installing on virtual reality device detects described human eye sight.
Preferably, described bounding box is quad patch, and described step S002 specifically includes: each
The corresponding one group of coordinate in described UI control position in described quad patch, coordinate bag described in a group
Include four coordinate points, if the coordinate of described intersection location is positioned in the range of coordinate described in a group, then
Described UI control is selected UI control.
Preferably, described step S001 specifically includes: if detecting, described human eye sight changes,
Then obtain described human eye sight.
Preferably, the UI that multiple described UI control is same type of same described bounding box it is contained in
Control.
On the other hand, the present invention also proposes a kind of to judge that the UI control of virtual reality applications is selected
Device, including: obtain human eye sight module, be used for obtaining human eye sight；Judge and perform module,
If intersecting with the bounding box being used for holding multiple described UI control for described human eye sight, then calculate
Described human eye sight intersection location in described bounding box, makees the UI control of described intersection location
For selected UI control, perform described selected UI control and choose event accordingly.
Preferably, the gyroscope by installing on virtual reality device detects described human eye sight.
Preferably, described bounding box is quad patch, and described judgement specifically includes with performing module:
The corresponding one group of coordinate in each described UI control position in described quad patch, sits described in one group
Mark includes four coordinate points, if the coordinate of described intersection location is positioned in the range of coordinate described in a group,
The most described UI control is selected UI control.
Preferably, described acquisition human eye sight module specifically includes: if described human eye sight being detected
Change, then obtain described human eye sight.
Preferably, the UI that multiple described UI control is same type of same described bounding box it is contained in
Control.
Use technique scheme, have the advantages that
By obtaining human eye sight, according to human eye sight and the bounding box for holding multiple UI control
The intersection location produced when intersecting judges selected UI control, performs selected UI control phase
The mode choosing event answered solves each UI control in prior art needs a bounding box
Problem, improves rendering efficiency.
Accompanying drawing explanation
Fig. 1 is to judge that the UI control of virtual reality applications is selected according to an embodiment of the invention
The flow chart of method；
Fig. 2 is to judge that the UI control of virtual reality applications is selected in accordance with another embodiment of the present invention
In the flow chart of method；
Fig. 3 is to judge that the UI control of virtual reality applications is selected in accordance with another embodiment of the present invention
In the block diagram of device.
Detailed description of the invention
Below in conjunction with specific embodiments and accompanying drawing, the present invention is further described in detail.Its
It is only intended to elaborate specific embodiments of the present invention, the present invention is not produced any restriction,
Protection scope of the present invention is as the criterion with claims.
With reference to Fig. 1, the present invention proposes the side that a kind of UI control judging virtual reality applications is selected
Method, including: step S001, obtain human eye sight；Step S002, if human eye sight be used for containing
The bounding box putting multiple UI control intersects, then calculate human eye sight intersection location in bounding box,
Using the UI control of intersection location as selected UI control, perform selected UI control and choose thing accordingly
Part.For the virtual reality device of wear-type based on mobile phone, the method obtaining human eye sight is preferred
Gyroscope is used to obtain human eye sight.In step S002, the kind of bounding box has axle alignment to surround
Box (Axis Aligned Bounding Box is called for short: AABB bounding box) and oriented bounding box
(Oriented Bounding Box is called for short: OBB bounding box), bounding box is collision inspection in 3D
Survey.
Multiple UI controls position in bounding box, for pre-setting, can use shape library OpenGL
In ES, the mechanism of auto linear computation model dough sheet texture coordinate distributes UI control in bounding box
Position.The corresponding one group of coordinate in each UI control position in bounding box, one group of seat of UI control
Mark can store with the corresponding relation of UI control by the way of mapping table.When human eye sight being detected
After intersecting with bounding box, record the coordinate that intersects of human eye sight and bounding box intersection location, circulation
One group of coordinate that crossing coordinate is corresponding with each the UI control in bounding box is compared, until looking for
It is positioned at one group of coordinate range corresponding to UI control to crossing coordinate then to stop comparing, now looks for
To selected UI control, perform selected UI control and choose event accordingly.For bounding box, prison is set
Listen function, monitoring function is set for each UI control, when the monitoring function of bounding box listens to human eye
Sight line intersects then execution circulation by crossing coordinate and each the UI control in bounding box with bounding box
The action that one group of corresponding coordinate compares.When the monitoring function of UI control, to listen to UI control selected
In, then perform selected UI control and choose event accordingly.
By obtaining human eye sight, according to human eye sight and the bounding box for holding multiple UI control
The intersection location produced when intersecting judges selected UI control, performs selected UI control phase
The mode choosing event answered solves each UI control in prior art needs a bounding box
Problem, makes a bounding box can accommodate multiple UI control simultaneously, improves 3D effect and render effect
Rate.
In one of which embodiment, by the gyroscope detection people installed on virtual reality device
An eye line.For virtual reality device based on mobile phone, use the gyroscope detection carried on mobile phone
Human eye sight need not additionally increase detection human eye sight device, provides cost savings.
In one of which embodiment, bounding box is quad patch, and step S002 specifically includes:
The corresponding one group of coordinate in each UI control position in quad patch, one group of coordinate includes four seats
Punctuate, if the coordinate of intersection location is positioned in the range of one group of coordinate, then UI control is selected UI
Control.Using quad patch to build bounding box is a kind of building mode in 3D rendering.Four
In the shape dough sheet of limit, absolute coordinate can be used to represent position, it would however also be possible to employ iconology uses
Texture coordinate represents position.
Being pre-created a quad patch for holding multiple UI control, each UI control is four
The most corresponding one group of coordinate in position in the shape dough sheet of limit, by the coordinate of intersection location and each UI control
One group of coordinate compares, when the coordinate finding intersection location is positioned at one group of seat corresponding to UI control
Time in the range of mark, terminate to compare, now find selected UI control.
In one of which embodiment, step S001 specifically includes: if detecting, human eye sight is sent out
Changing, then obtain human eye sight.Go again when human eye sight changes to detect human eye sight,
The device making detection human eye sight need not go constantly to detect human eye sight, improves efficiency.
Monitoring mechanism can be used to go to monitor whether human eye sight changes, regard when listening to human eye
Line changes, and just goes to obtain human eye sight.Use monitoring mechanism can improve program operational efficiency.
In one of which embodiment, the multiple UI controls being contained in same bounding box are similar
The UI control of type.The UI control of same type is placed in same bounding box, more convenient management.
It is placed in such as the UI control of game class being placed on same bounding box or by the UI control of video display class
In same bounding box, can more convenient find when using these UI controls.
With reference to Fig. 2, as highly preferred embodiment of the present invention, hold multiple similar by a bounding box
The UI control of type, finds selected UI control according to the intersection location of human eye sight Yu bounding box.
S201, uses same quad patch to hold the UI control of multiple same types, and storage is every simultaneously
One group of coordinate that individual UI control position in quad patch is corresponding；S202, for quad patch
Monitoring function is set, for each the UI control in quad patch, monitoring function is set, for gyro
Instrument arranges monitoring function；S203, changes when the monitoring function of gyroscope listens to human eye sight
Time, obtain human eye sight；S204, if the monitoring function of quad patch listen to human eye sight with
When quad patch intersects, the crossing coordinate of record intersection location；S205, the prison of quad patch
Function is listened to perform one group of corresponding with each UI control being positioned in quad patch for crossing coordinate seat
The action that mark compares, if finding crossing coordinate to be positioned at one group of coordinate model corresponding to UI control
In enclosing, then judge that this UI control is selected；S206, the monitoring function prison of selected UI control
Hear that UI control is selected, perform selected UI control and choose event accordingly.
With reference to Fig. 3, the present invention also proposes a kind of to judge that the UI control of virtual reality applications is selected
Device, including: obtain human eye sight module 301, be used for obtaining human eye sight；Judge and perform mould
Block 302, if intersecting with the bounding box being used for holding multiple UI control for human eye sight, then calculates
Human eye sight intersection location in bounding box, controls the UI control of intersection location as selected UI
Part, performs selected UI control and chooses event accordingly.
In one of which embodiment, by the gyroscope detection people installed on virtual reality device
An eye line.
In one of which embodiment, bounding box is quad patch, it is judged that with execution module 302
Specifically include: the corresponding one group of coordinate in each UI control position in quad patch, one group of coordinate
Including four coordinate points, if the coordinate of intersection location is positioned in the range of one group of coordinate, then UI control
For selected UI control.
In one of which embodiment, obtain human eye sight module 301 and specifically include: if detection
Change to human eye sight, then obtain human eye sight.
In one of which embodiment, the multiple UI controls being contained in same bounding box are similar
The UI control of type.
Above-described is only principle and the preferred embodiment of the present invention.It should be pointed out that, for this
For the those of ordinary skill in field, on the basis of the principle of the invention, it is also possible to make some its
Its modification, also should be regarded as protection scope of the present invention.
Claims (10)
1. the method that the UI control judging virtual reality applications is selected, it is characterised in that bag
Include:
Step S001, obtains human eye sight；
Step S002, if described human eye sight and the bounding box phase for holding multiple described UI control
Hand over, then calculate described human eye sight intersection location in described bounding box, by described intersection location
UI control as selected UI control, perform described selected UI control and choose event accordingly.
The method that the UI control of judgement virtual reality applications the most according to claim 1 is selected,
It is characterized in that: detect described human eye sight by the gyroscope installed on virtual reality device.
The method that the UI control of judgement virtual reality applications the most according to claim 1 is selected,
It is characterized in that, described bounding box is quad patch, and described step S002 specifically includes: each
The corresponding one group of coordinate in described UI control position in described quad patch, coordinate bag described in a group
Include four coordinate points, if the coordinate of described intersection location is positioned in the range of coordinate described in a group, then
Described UI control is selected UI control.
The method that the UI control of judgement virtual reality applications the most according to claim 1 is selected,
It is characterized in that, described step S001 specifically includes: if detecting, described human eye sight changes,
Then obtain described human eye sight.
The method that the UI control of judgement virtual reality applications the most according to claim 1 is selected,
It is characterized in that, be contained in the UI that multiple described UI control is same type of same described bounding box
Control.
6. the device that the UI control judging virtual reality applications is selected, it is characterised in that bag
Include:
Obtain human eye sight module, be used for obtaining human eye sight；
Judge and perform module, if being used for described human eye sight and being used for holding multiple described UI control
Bounding box intersect, then calculate described human eye sight intersection location in described bounding box, by institute
State the UI control of intersection location as selected UI control, perform described selected UI control and select accordingly
Middle event.
The device that the UI control of judgement virtual reality applications the most according to claim 6 is selected,
It is characterized in that: detect described human eye sight by the gyroscope installed on virtual reality device.
The device that the UI control of judgement virtual reality applications the most according to claim 6 is selected,
It is characterized in that, described bounding box is quad patch, and described judgement specifically includes with performing module:
The corresponding one group of coordinate in each described UI control position in described quad patch, sits described in one group
Mark includes four coordinate points, if the coordinate of described intersection location is positioned in the range of coordinate described in a group,
The most described UI control is selected UI control.
The device that the UI control of judgement virtual reality applications the most according to claim 6 is selected,
It is characterized in that, described acquisition human eye sight module specifically includes: if described human eye sight being detected
Change, then obtain described human eye sight.
The dress that the UI control of judgement virtual reality applications the most according to claim 6 is selected
Put, it is characterised in that the multiple described UI control being contained in same described bounding box is same type
UI control.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510785543.3A CN105892632A (en) | 2015-11-16 | 2015-11-16 | Method and device for judging the selection of UI (User Interface) widgets of virtual reality application |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510785543.3A CN105892632A (en) | 2015-11-16 | 2015-11-16 | Method and device for judging the selection of UI (User Interface) widgets of virtual reality application |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105892632A true CN105892632A (en) | 2016-08-24 |
Family
ID=57001904
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510785543.3A Pending CN105892632A (en) | 2015-11-16 | 2015-11-16 | Method and device for judging the selection of UI (User Interface) widgets of virtual reality application |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105892632A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106861184A (en) * | 2016-12-28 | 2017-06-20 | 北京乐动卓越科技有限公司 | A kind of method and system that man-machine interaction is realized in immersion VR game |
| CN107145227A (en) * | 2017-04-20 | 2017-09-08 | 腾讯科技（深圳）有限公司 | The exchange method and device of virtual reality scenario |
| CN108536288A (en) * | 2018-03-27 | 2018-09-14 | 网易（杭州）网络有限公司 | The treating method and apparatus of interactive operation in virtual reality |
| CN109101102A (en) * | 2017-06-20 | 2018-12-28 | 北京行云时空科技有限公司 | Widget interaction method, apparatus and system for VR/AR |
| CN109766012A (en) * | 2019-02-02 | 2019-05-17 | 京东方科技集团股份有限公司 | Sight calculations method and device |
| CN110060537A (en) * | 2019-03-22 | 2019-07-26 | 珠海超凡视界科技有限公司 | A kind of virtual reality drives training device and its man-machine interaction method |
| CN111522442A (en) * | 2020-04-09 | 2020-08-11 | 中国电子科技集团公司第三十八研究所 | interaction method and device for ARKit augmented reality environment on iOS device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102830793A (en) * | 2011-06-16 | 2012-12-19 | 北京三星通信技术研究有限公司 | Sight tracking method and sight tracking device |
| CN103631364A (en) * | 2012-08-20 | 2014-03-12 | 联想(北京)有限公司 | Control method and electronic device |
| CN104536654A (en) * | 2014-12-25 | 2015-04-22 | 小米科技有限责任公司 | Menu selecting method and device on intelligent wearable device and intelligent wearable device |
| CN104793842A (en) * | 2014-01-16 | 2015-07-22 | 卡西欧计算机株式会社 | GUI system, display processing device, and input processing device |
| CN104915099A (en) * | 2015-06-16 | 2015-09-16 | 努比亚技术有限公司 | Icon sorting method and terminal equipment |
-
2015
- 2015-11-16 CN CN201510785543.3A patent/CN105892632A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102830793A (en) * | 2011-06-16 | 2012-12-19 | 北京三星通信技术研究有限公司 | Sight tracking method and sight tracking device |
| CN103631364A (en) * | 2012-08-20 | 2014-03-12 | 联想(北京)有限公司 | Control method and electronic device |
| CN104793842A (en) * | 2014-01-16 | 2015-07-22 | 卡西欧计算机株式会社 | GUI system, display processing device, and input processing device |
| CN104536654A (en) * | 2014-12-25 | 2015-04-22 | 小米科技有限责任公司 | Menu selecting method and device on intelligent wearable device and intelligent wearable device |
| CN104915099A (en) * | 2015-06-16 | 2015-09-16 | 努比亚技术有限公司 | Icon sorting method and terminal equipment |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106861184A (en) * | 2016-12-28 | 2017-06-20 | 北京乐动卓越科技有限公司 | A kind of method and system that man-machine interaction is realized in immersion VR game |
| CN107145227A (en) * | 2017-04-20 | 2017-09-08 | 腾讯科技（深圳）有限公司 | The exchange method and device of virtual reality scenario |
| WO2018192394A1 (en) * | 2017-04-20 | 2018-10-25 | 腾讯科技（深圳）有限公司 | Interaction method and apparatus for virtual reality scene, storage medium and electronic apparatus |
| CN107145227B (en) * | 2017-04-20 | 2019-01-08 | 腾讯科技（深圳）有限公司 | The exchange method and device of virtual reality scenario |
| CN109101102A (en) * | 2017-06-20 | 2018-12-28 | 北京行云时空科技有限公司 | Widget interaction method, apparatus and system for VR/AR |
| CN108536288A (en) * | 2018-03-27 | 2018-09-14 | 网易（杭州）网络有限公司 | The treating method and apparatus of interactive operation in virtual reality |
| CN109766012A (en) * | 2019-02-02 | 2019-05-17 | 京东方科技集团股份有限公司 | Sight calculations method and device |
| CN109766012B (en) * | 2019-02-02 | 2022-04-29 | 京东方科技集团股份有限公司 | Sight line calculation method and device |
| CN110060537A (en) * | 2019-03-22 | 2019-07-26 | 珠海超凡视界科技有限公司 | A kind of virtual reality drives training device and its man-machine interaction method |
| CN111522442A (en) * | 2020-04-09 | 2020-08-11 | 中国电子科技集团公司第三十八研究所 | interaction method and device for ARKit augmented reality environment on iOS device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105892632A (en) | Method and device for judging the selection of UI (User Interface) widgets of virtual reality application | |
| US10026209B1 (en) | Ground plane detection for placement of augmented reality objects | |
| US20150356770A1 (en) | Street view map display method and system | |
| JP6290754B2 (en) | Virtual space display device, virtual space display method and program | |
| US9406116B2 (en) | Electronic device and method for measuring point cloud of an object | |
| EP2796963A1 (en) | Display control method and device | |
| CN105302407A (en) | Application icon display method and apparatus | |
| US20120328211A1 (en) | System and method for splicing images of workpiece | |
| US20210183137A1 (en) | Potentially visible set determining method and apparatus, device, and storage medium | |
| US20130181971A1 (en) | Automatic Plane Alignment in 3D Environment | |
| CN104765156B (en) | A kind of three-dimensional display apparatus and 3 D displaying method | |
| CN104142786B (en) | A kind of prompting frame display methods and terminal | |
| US20170132847A1 (en) | Method and System for Selectively Blending Buildings to Improve Route Visibility in a 3D Navigation System | |
| US11562545B2 (en) | Method and device for providing augmented reality, and computer program | |
| JP2017010241A5 (en) | ||
| CN110163980A (en) | A kind of data processing method and device based on AR | |
| US20150112655A1 (en) | Computing device and method for simulating measurement of object | |
| CN103995771B (en) | Task Progress methods of exhibiting and system | |
| CN103902580A (en) | Method and device for dragging multiple elements in webpage | |
| KR101894793B1 (en) | Apparatus and method for augmented reality based on mirror display | |
| CN110782534B (en) | 3D character color gradient method, medium, equipment and device | |
| EP3133808A3 (en) | Apparatus, system, and method of controlling display of image, and carrier means | |
| JP2016515741A (en) | Pan and scaling detection during multi-finger touch interaction | |
| WO2016020778A1 (en) | A method, mobile device and computer program for substituting a furnishing covering surface of in an image | |
| CN109781144A (en) | Data correcting method, device, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160824 |