CN106843719A - Method and system, the VR equipment of touch-screen applications are realized in virtual screen - Google Patents
Method and system, the VR equipment of touch-screen applications are realized in virtual screen Download PDFInfo
- Publication number
- CN106843719A CN106843719A CN201611200815.XA CN201611200815A CN106843719A CN 106843719 A CN106843719 A CN 106843719A CN 201611200815 A CN201611200815 A CN 201611200815A CN 106843719 A CN106843719 A CN 106843719A
- Authority
- CN
- China
- Prior art keywords
- touch
- screen
- point
- virtual screen
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses realizing the method for touch-screen applications in virtual screen, realize in virtual screen the system and VR equipment of touch-screen applications.The described method comprises the following steps：Touch-screen applications are included on virtual screen；Detect that ray being sent from hither plane center, extending to far plane center and the virtual screen whether there is the position of intersection point and the intersection point in the virtual screen；Coordinate of the corresponding touch point of the intersection point in touch panel coordinates system is determined according to position of the intersection point in the virtual screen.It is that the application of touch screen design can also be used on virtual reality device by technical scheme.
Description
Technical field
The present invention relates to virtual reality technology, more particularly, to realized in virtual screen touch-screen applications method,
System, the VR equipment of touch-screen applications are realized in virtual screen.
Background technology
Touch-screen has become the mainstream configuration of intelligent electronic device, and many applications are all based on touch-screen realization, example
The map application such as realized based on touch-screen, these applications for being based on touch-screen realization are referred to as touch-screen applications.Touch-screen
The principle of application is：By detecting that the modes such as capacitance variations obtain coordinate of the touch point in touch panel coordinates system, touch-screen
Parsed using to touching point coordinate data, determine that the operation of user performs corresponding operation after being intended to.
With the progressively maturation of virtual reality (Virtual Reality, VR) technology, various virtual reality devices go out successively
It is existing.Deficient in order to solve the problems, such as the application of the virtual reality device early stage of development, some manufacturers are developed on virtual reality device
The pattern of existing common application is run, system can create a virtual scene under the pattern, then by the interface of common application
It is displayed on a virtual screen in virtual scene.But virtual screen cannot be touched, this means that to be touch-screen
The touch-screen applications of design cannot be applied under this pattern.
The content of the invention
Method it is an object of the present invention to provide touch-screen applications are realized in virtual screen.
According to the first aspect of the invention, there is provided a kind of method that touch-screen applications are realized in virtual screen, including
Following steps：
Touch-screen applications are included on virtual screen；
Ray that detection sends from hither plane center, to the extension of far plane center whether there is with the virtual screen to be handed over
The position of point and the intersection point in the virtual screen；
Determine that the corresponding touch point of the intersection point is sat in touch-screen according to position of the intersection point in the virtual screen
Coordinate in mark system.
Alternatively, the virtual screen is located in visible space near the position of hither plane.
Alternatively, it is further comprising the steps of：If the operation of simulated touch is triggered and the ray is virtual with described
There is intersection point in screen, then send the message that is pressed of touch-screen and the corresponding touch point of the intersection point in touch panel coordinates system
Coordinate to the touch-screen applications；Continue to send the corresponding touch point of the intersection point in touch-screen seat according to intervals
Coordinate in mark system, until the operation of simulated touch is stopped and/or the intersection point disappears；What transmission touch-screen was released disappears
Cease to the touch-screen applications.
Alternatively, the virtual screen is combined into by triangle virtual screen；Methods described is further comprising the steps of：Using penetrating
What line and triangle intersections detection algorithm detected the ray and the triangle virtual screen intersects situation, determines the ray
Whether there is the position of intersection point and the intersection point in the virtual screen with the virtual screen.
Alternatively, in hither plane center display highlighting.
According to the second aspect of the invention, there is provided a kind of method that touch-screen applications are realized in virtual screen, including
Following steps：
Touch-screen applications are included on virtual screen；
Whether ray that detection sends from hither plane center, extending to far plane center is collided on the virtual screen
And position of the point of impingement in the virtual screen；
Determine that the corresponding touch point of the point of impingement is touching according to position of the point of impingement in the virtual screen
Coordinate in screen coordinate system.
Alternatively, it is further comprising the steps of：If the operation of simulated touch is triggered and ray collision is described
On virtual screen, then the message that is pressed of touch-screen and the corresponding touch point of the point of impingement are sent in touch panel coordinates system
Coordinate to the touch-screen applications；Continue to send the corresponding touch point of the point of impingement in touch-screen according to intervals
Coordinate in coordinate system, until the operation of simulated touch is stopped and/or the point of impingement disappears；Touch-screen is sent to be released
Message to the touch-screen applications.
Alternatively, in hither plane center display highlighting.
According to the third aspect of the invention we, a kind of VR equipment is additionally provided, with processor and memory, the memory
For store instruction, the instruction is used to control the processor to be operated to perform the side according to foregoing any one
Method.
According to the fourth aspect of the invention, there is provided a kind of system that touch-screen applications are realized in virtual screen, including
With lower module：
Touch-screen applications display module, for touch-screen applications to be included in virtual screen；
Breakpoint detection module, for detect it is being sent from hither plane center, to far plane center extend ray with it is described
Virtual screen whether there is the position of intersection point and the intersection point in the virtual screen；
Point coordinates determining module is touched, the intersection point is determined for the position according to the intersection point in the virtual screen
Coordinate of the corresponding touch point in touch panel coordinates system.
Alternatively, the virtual screen is located in visible space near the position of hither plane.
Alternatively, the system also includes contact control module：The contact control module, if for simulated touch
Operation is triggered and the ray has intersection point with the virtual screen, then send message and the friendship that touch-screen is pressed
Put coordinate of the corresponding touch point in touch panel coordinates system to the touch-screen applications；Continue to send out according to intervals
Send coordinate of the corresponding touch point of the intersection point in touch panel coordinates system, until the operation of simulated touch be stopped and/or
The intersection point disappears；Send the message that is released of touch-screen to the touch-screen applications.
Alternatively, the virtual screen is combined into by triangle virtual screen；The breakpoint detection module, for using ray
Intersect situation with triangle intersections detection algorithm detects the ray and the triangle virtual screen, determine the ray with
The virtual screen whether there is the position of intersection point and the intersection point in the virtual screen.
According to the fifth aspect of the invention, there is provided a kind of system that touch-screen applications are realized in virtual screen, including
With lower module：
Touch-screen applications display module, for touch-screen applications to be included in virtual screen；
Collision detection module, for detecting whether ray being sent from hither plane center, extending to far plane center touches
Hit on the virtual screen and position of the point of impingement in the virtual screen；
Point coordinates determining module is touched, for being touched described in the position determination according to the point of impingement in the virtual screen
Hit a little coordinate of the corresponding touch point in touch panel coordinates system.
Alternatively, the system also includes contact control module：The contact control module, if the operation of simulated touch
It is triggered and ray collision sends message and the point of impingement pair that touch-screen is pressed on the virtual screen, then
Coordinate of the touch point answered in touch panel coordinates system is to the touch-screen applications；Continue to send institute according to intervals
Coordinate of the corresponding touch point of the point of impingement in touch panel coordinates system is stated, until the operation of simulated touch is stopped and/or institute
State point of impingement disappearance；Send the message that is released of touch-screen to the touch-screen applications.
The technical scheme that touch-screen applications are realized in virtual screen provided using the present invention, is originally used for touch screen design
Touch-screen applications can also be used on virtual reality device.
By referring to the drawings to the detailed description of exemplary embodiment of the invention, further feature of the invention and its
Advantage will be made apparent from.
Brief description of the drawings
The accompanying drawing for being combined in the description and constituting a part for specification shows embodiments of the invention, and even
It is used to explain principle of the invention together with its explanation.
Fig. 1 is the flow chart of the method that touch-screen applications are realized in virtual screen that first embodiment of the invention is provided.
Fig. 2 is the flow chart of the method that touch-screen applications are realized in virtual screen that second embodiment of the invention is provided.
Fig. 3 is the block diagram of the system that touch-screen applications are realized in virtual screen provided in an embodiment of the present invention.
Fig. 4 is the block diagram of the system that touch-screen applications are realized in virtual screen that another embodiment of the present invention is provided.
Fig. 5 is the hardware configuration schematic diagram of VR equipment provided in an embodiment of the present invention.
Specific embodiment
Describe various exemplary embodiments of the invention in detail now with reference to accompanying drawing.It should be noted that：Unless had in addition
Body illustrates that the part and the positioned opposite of step, numerical expression and numerical value for otherwise illustrating in these embodiments do not limit this
The scope of invention.
The description only actually at least one exemplary embodiment is illustrative below, never as to the present invention
And its any limitation applied or use.
May be not discussed in detail for technology, method and apparatus known to person of ordinary skill in the relevant, but suitable
In the case of, the technology, method and apparatus should be considered as a part for specification.
In all examples shown here and discussion, any occurrence should be construed as merely exemplary, without
It is as limitation.Therefore, other examples of exemplary embodiment can have different values.
It should be noted that：Similar label and letter represents similar terms in following accompanying drawing, therefore, once a certain Xiang Yi
It is defined in individual accompanying drawing, then it need not be further discussed in subsequent accompanying drawing.
With reference to the method that touch-screen applications are realized in virtual screen that Fig. 1 explanation first embodiment of the invention is provided, bag
Include following steps：
101st, touch-screen applications are included on virtual screen.
When user uses virtual reality device, system can create virtual scene, and virtual screen is provided with virtual scene, will
Touch-screen applications are displayed on virtual screen.In order to adapt to the visual custom of people, virtual screen can be rectangle.
In virtual reality technology, visual field (a usually truncated rectangular pyramids) composition between hither plane and far plane is visual empty
Between, in another embodiment, virtual screen can be made to be always positioned in visible space near the position of hither plane, to press close to
The visual custom of user.
102nd, detect whether ray being sent from hither plane center, extending to far plane center is deposited with the virtual screen
In the position of intersection point and the intersection point in the virtual screen.
That is, the present invention is to represent user with ray being sent from hither plane center, extending to far plane center
Finger orientation, represent touch point with the intersection point of ray and virtual screen.
The detection method of step 102 is illustrated by taking rectangular screen as an example, rectangular virtual screen can be regarded as with diagonal point
Two triangle virtual screens on boundary, thus can using ray and triangle intersections detection algorithm detect the ray and each
The intersecting situation of triangle virtual screen, so that it is determined that the ray whether there is intersection point, and the friendship with rectangular virtual screen
Position of the point in rectangular virtual screen.This detection method is applied to the virtual screen that can be analyzed to several triangles, example
Such as rectangular virtual screen, triangle virtual screen, square virtual screen, regular pentagon virtual screen.
103rd, the position according to the intersection point in the virtual screen determines that the corresponding touch point of the intersection point is touching
Coordinate in screen coordinate system.
Position of the corresponding touch point of intersection point in touch-screen can be obtained in the position of virtual screen according to intersection point, also
Coordinate of the touch point in touch panel coordinates system can be obtained, so that realization intersection point represents touch point.
Further, if the operation of simulated touch is triggered and the ray has intersection point with the virtual screen,
The coordinate of the touch-screen message and the corresponding touch point of the intersection point that are pressed in touch panel coordinates system is then sent to described
Touch-screen applications；Then, continue to send the corresponding touch point of the intersection point in touch panel coordinates system according to intervals
In coordinate, until the operation of simulated touch be stopped and/or the intersection point disappear (i.e. described ray does not have with the virtual screen
Have intersection point), the message that transmission touch-screen is released to the touch-screen applications.
For example, being provided with button on the handle of VR equipment, the button is operated for simulated touch, then touch control operation process
For：When the button is pressed, the operation of simulated touch is triggered, if now the ray has friendship with the virtual screen
Point, then coordinate of the message and the corresponding touch point of the intersection point that transmission touch-screen is pressed in touch panel coordinates system to institute
State touch-screen applications；According to the corresponding touch point of the intervals continuation transmission intersection point in touch panel coordinates system
Coordinate, at least one situation in button is released or the intersection point disappears occurs；Button is released or the intersection point disappears
Mistake represents touch-screen and is released, the message that transmission touch-screen is released to the touch-screen applications.
As a rule, when VR equipment is designed, hither plane center is general just to user's binocular center.So in an implementation
In example, a cursor can be shown on hither plane center, light target Main Function is to aid in user and is positioned, when cursor pair
Illustrate that the ray has intersection point with the virtual screen during quasi- virtual screen.
The side that touch-screen applications are realized in virtual screen that second embodiment of the invention is provided is illustrated with reference to shown in Fig. 2
Method, comprises the following steps：
201st, touch-screen applications are included on virtual screen.
202nd, detect whether ray being sent from hither plane center, extending to far plane center is collided in the virtual screen
On curtain and position of the point of impingement in the virtual screen.
203rd, the position according to the point of impingement in the virtual screen determines that the corresponding touch point of the point of impingement exists
Coordinate in touch panel coordinates system.
If also having in visible space, another dummy object is closer to hither plane and blocks virtual screen, from hither plane
Ray that the heart sends, extending to far plane center may be collided first on the dummy object run at first in visible space,
Then just there is intersection point with virtual screen；In a second embodiment, such case can be considered as that user is not intended to virtual screen
Curtain is operated, and by the collision detection of step 202, only described ray collision can just perform follow-up dynamic on virtual screen
Make, it is to avoid maloperation to virtual screen.
Further, if the operation of simulated touch is triggered and ray collision is on the virtual screen,
The coordinate of the touch-screen message and the corresponding touch point of the point of impingement that are pressed in touch panel coordinates system is sent to described
Touch-screen applications；Then, continue to send the corresponding touch point of the point of impingement in touch panel coordinates system according to intervals
Coordinate in system, until the operation of simulated touch be stopped and/or the point of impingement disappear (i.e. described ray is not collided in institute
State on virtual screen), the message that transmission touch-screen is released to the touch-screen applications.
For example, being provided with button on the handle of VR equipment, the button is operated for simulated touch, then touch control operation process
For：When the button is pressed, the operation of simulated touch is triggered, if now the ray collision is in the virtual screen
On, then coordinate of the message and the corresponding touch point of the point of impingement that transmission touch-screen is pressed in touch panel coordinates system is extremely
The touch-screen applications；Continue to send the corresponding touch point of the point of impingement in touch panel coordinates system according to intervals
In coordinate, until button be released or the point of impingement disappear at least one situation occur；Button is released or described
Point of impingement disappearance represents touch-screen and is released, the message that transmission touch-screen is released to the touch-screen applications.
As a rule, when VR equipment is designed, hither plane center is general just to user's binocular center.So in an implementation
In example, a cursor can be shown on hither plane center, cursor can aid in user to be positioned.
To those skilled in the art, can be hardware mode, software mode or reality by way of software and hardware combining
The existing foregoing method that touch-screen applications are realized in virtual screen.Based on same inventive concept, this hair is introduced with reference to Fig. 3 and Fig. 4
The system of display direction billboard in live-action map of bright embodiment, to perform the foregoing display direction billboard in live-action map
Scheme.
With reference to shown in Fig. 3, the system that touch-screen applications are realized in virtual screen, including with lower module：
Touch-screen applications display module 11, for touch-screen applications to be included into the virtual screen in virtual screen.
Breakpoint detection module 12, for detecting ray being sent from hither plane center, extending to far plane center and institute
Virtual screen is stated with the presence or absence of the position of intersection point and the intersection point in the virtual screen.
Point coordinates determining module 13 is touched, the friendship is determined for the position according to the intersection point in the virtual screen
Coordinate of the corresponding touch point of point in touch panel coordinates system.
Contact control module 14, if the operation for simulated touch is triggered and the ray and the virtual screen
There is intersection point, then seat of the message and the corresponding touch point of the intersection point that transmission touch-screen is pressed in touch panel coordinates system
Mark to the touch-screen applications；Continue to send the corresponding touch point of the intersection point in touch panel coordinates system according to intervals
Coordinate in system, until the operation of simulated touch is stopped and/or the intersection point disappears；The message that transmission touch-screen is released is extremely
The touch-screen applications.
Alternatively, the virtual screen is located in visible space near the position of hither plane
Alternatively, the virtual screen is combined into by triangle virtual screen, the breakpoint detection module 12, is penetrated for using
What line and triangle intersections detection algorithm detected the ray and the triangle virtual screen intersects situation, determines the ray
Whether there is the position of intersection point and the intersection point in the virtual screen with the virtual screen.
With reference to shown in Fig. 4, the system that touch-screen applications are realized in virtual screen, including with lower module：
Touch-screen applications display module 21, for touch-screen applications to be included into the virtual screen in virtual screen.
Collision detection module 22, for detect it is being sent from hither plane center, to far plane center extend ray whether
The position that collision is on the virtual screen and the point of impingement is in the virtual screen.
Point coordinates determining module 23 is touched, for described in the position determination according to the point of impingement in the virtual screen
Coordinate of the corresponding touch point of the point of impingement in touch panel coordinates system.
Contact control module 24, if the operation of simulated touch is triggered and ray collision is in the virtual screen
On, then coordinate of the message and the corresponding touch point of the point of impingement that transmission touch-screen is pressed in touch panel coordinates system is extremely
The touch-screen applications；Continue to send the corresponding touch point of the point of impingement in touch panel coordinates system according to intervals
In coordinate, until the operation of simulated touch be stopped and/or the point of impingement disappear；The message that transmission touch-screen is released is extremely
The touch-screen applications.
It is that the application of touch screen design can also be used on virtual reality device by technical scheme, expands
The big range of application of virtual reality device.
With reference to shown in Fig. 5, the hardware configuration of VR equipment provided in an embodiment of the present invention is illustrated.VR equipment 300 can include
Processor 3010, memory 3020, interface arrangement 3030, action bars/button 3040, display device 3050, communicator 3060,
Loudspeaker 3070, microphone 3080 etc..
Memory 3020 is used for store instruction, and the instruction is operated foregoing in void to perform for control process device 3010
The method that touch-screen applications are realized in plan screen.
Processor 3010 for example can be central processor CPU, Micro-processor MCV etc..Memory 3020 for example includes ROM
(read-only storage), RAM (random access memory), the nonvolatile memory of hard disk etc..Interface arrangement 3030 is for example
Including USB interface, earphone interface etc..Communicator 3040 can for example carry out wired or wireless communication.Display device 3050
LCDs etc. in this way.Action bars/button 3040 is available for user input order.User can be by loudspeaker 3070 and Mike
The inputting/outputting voice information of wind 3080.
VR equipment shown in Fig. 5 is only explanatory, and is never intended to limit the application or use of the invention.
The system that touch-screen applications are realized in virtual screen and VR equipment that the embodiment of the present invention is provided, it realizes former
Reason and the technique effect for producing are identical with preceding method embodiment, and to briefly describe, device embodiment part does not refer to part, can
With reference to corresponding contents in preceding method embodiment.
It should be noted that each embodiment in this specification is described by the way of progressive, each embodiment weight
Point explanation is all difference with other embodiment, between each embodiment identical similar part mutually referring to.
But it will be clear for those skilled in the art that the various embodiments described above can as needed be used alone or be combined with each other make
With.In addition, for device embodiment, because it is corresponding with embodiment of the method, so describe fairly simple, it is related
Part referring to the corresponding part of embodiment of the method explanation.System embodiment described above be only it is schematical,
The module for wherein being illustrated as separating component can be or to may also be not physically separate.
In addition, the flow chart and block diagram in accompanying drawing show system, method and the meter of multiple embodiments of the invention
The architectural framework in the cards of calculation machine program product, function and operation.At this point, each square frame in flow chart or block diagram
Can represent a part for module, program segment or code, the part of the module, program segment or code comprising one or
The executable instruction of logic function of the multiple for realizing specifying.It should also be noted that in some realizations as replacement, square frame
Middle marked function can also occur with different from the order marked in accompanying drawing.For example, two continuous square frames are actually
Can perform substantially in parallel, they can also be performed in the opposite order sometimes, this is depending on involved function.Also to note
Meaning, the combination of the square frame in each square frame and block diagram and/or flow chart in block diagram and/or flow chart can be with holding
The fixed function of professional etiquette or the special hardware based system of action are realized, or can use specialized hardware and computer instruction
Combination realize.
The present invention can be system, method and/or computer program product.Computer program product can include computer
Readable storage medium storing program for executing, containing for making processor realize the computer-readable program instructions of various aspects of the invention.This
The computer program product that inventive embodiments are provided, including the computer-readable recording medium of program code is stored, it is described
The instruction that program code includes can be used to perform the method described in previous methods embodiment, implements the method for can be found in and implements
Example, will not be repeated here.
It is apparent to those skilled in the art that, for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, may be referred to the corresponding process in preceding method embodiment, will not be repeated here.
In several embodiments provided herein, it should be understood that disclosed system, apparatus and method, can be with
Realize by another way.Device embodiment described above is only schematical, for example, the division of the unit,
It is only a kind of division of logic function, there can be other dividing mode when actually realizing, but for example, multiple units or component can
To combine or be desirably integrated into another system, or some features can be ignored, or not perform.It is another, it is shown or beg for
The coupling each other of opinion or direct-coupling or communication connection can be by some communication interfaces, device or unit it is indirect
Coupling is communicated to connect, and can be electrical, mechanical or other forms.
The unit that is illustrated as separating component can be or may not be it is physically separate, of the invention each
Each functional unit in individual embodiment can be integrated in a processing unit, or unit is individually physically present,
Can also two or more units it is integrated in a unit.
If the function is to realize in the form of SFU software functional unit and as independent production marketing or when using, can be with
Storage is in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words
The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used to so that a computer equipment (can be individual
People's computer, server, or network equipment etc.) perform all or part of step of each embodiment methods described of the invention.
And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (ROM, Read-Only Memory), arbitrary access are deposited
Reservoir (RAM, Random Access Memory), magnetic disc or CD etc. are various can be with the medium of store program codes.
It should be noted that herein, such as first and second or the like relational terms are used merely to a reality
Body or operation make a distinction with another entity or operation, and not necessarily require or imply these entities or deposited between operating
In any this actual relation or order.And, term " including ", "comprising" or its any other variant be intended to
Nonexcludability is included, so that process, method, article or equipment including a series of key elements not only will including those
Element, but also other key elements including being not expressly set out, or also include being this process, method, article or equipment
Intrinsic key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that
Also there is other identical element in process, method, article or equipment including the key element.
The preferred embodiments of the present invention are the foregoing is only, is not intended to limit the invention, for the skill of this area
For art personnel, the present invention can have various modifications and variations.All any modifications within the scope of the present invention, made, etc.
With replacement, improvement etc., should be included within the scope of the present invention.It should be noted that：Similar label and letter is below
Accompanying drawing in represent similar terms, therefore, once be defined in a certain Xiang Yi accompanying drawing, then need not be right in subsequent accompanying drawing
It is further defined and is explained.
Claims (15)
1. a kind of method that touch-screen applications are realized in virtual screen, it is characterised in that comprise the following steps：
Touch-screen applications are included on virtual screen；
Detection sent from hither plane center, to far plane center extend ray and the virtual screen with the presence or absence of intersection point with
And position of the intersection point in the virtual screen；
Determine the corresponding touch point of the intersection point in touch panel coordinates system according to position of the intersection point in the virtual screen
Coordinate in system.
2. method according to claim 1, it is characterised in that the virtual screen is located in visible space near near flat
The position in face.
3. method according to claim 1, it is characterised in that further comprising the steps of：
If the operation of simulated touch is triggered and the ray has intersection point with the virtual screen, touch-screen quilt is sent
The coordinate of the message of pressing and the corresponding touch point of the intersection point in touch panel coordinates system is to the touch-screen applications；
Continue to send coordinate of the corresponding touch point of the intersection point in touch panel coordinates system according to intervals, until
The operation of simulated touch is stopped and/or the intersection point disappears；
Send the message that is released of touch-screen to the touch-screen applications.
4. method according to claim 1, it is characterised in that the virtual screen is combined into by triangle virtual screen；Institute
State method further comprising the steps of：
Intersect situation using what ray and triangle intersections detection algorithm detected the ray and the triangle virtual screen, really
The fixed ray whether there is the position of intersection point and the intersection point in the virtual screen with the virtual screen.
5. the method according to claim any one of 1-4, it is characterised in that in hither plane center display highlighting.
6. a kind of method that touch-screen applications are realized in virtual screen, it is characterised in that comprise the following steps：
Touch-screen applications are included on virtual screen；
Ray that detection sends from hither plane center, extending to far plane center whether collide on the virtual screen and
Position of the point of impingement in the virtual screen；
Determine that the corresponding touch point of the point of impingement is sat in touch-screen according to position of the point of impingement in the virtual screen
Coordinate in mark system.
7. method according to claim 6, it is characterised in that further comprising the steps of：
If the operation of simulated touch is triggered and ray collision is on the virtual screen, sends touch-screen and pressed
The coordinate of the message of pressure and the corresponding touch point of the point of impingement in touch panel coordinates system is to the touch-screen applications；
Continue to send coordinate of the corresponding touch point of the point of impingement in touch panel coordinates system according to intervals, directly
Operation to simulated touch is stopped and/or the point of impingement disappears；
Send the message that is released of touch-screen to the touch-screen applications.
8. the method according to any one of claim 6 or 7, it is characterised in that in hither plane center display highlighting.
9. a kind of VR equipment, with processor and memory, it is characterised in that the memory is used for store instruction, the finger
Make for controlling the processor to be operated to perform according to any one of claim 1-7 described method.
10. a kind of system that touch-screen applications are realized in virtual screen, it is characterised in that including with lower module：
Touch-screen applications display module, for touch-screen applications to be included in virtual screen；
Breakpoint detection module, it is virtual with described for detecting ray being sent from hither plane center, extending to far plane center
Screen whether there is the position of intersection point and the intersection point in the virtual screen；
Point coordinates determining module is touched, the intersection point correspondence is determined for the position according to the intersection point in the virtual screen
Coordinate of the touch point in touch panel coordinates system.
11. systems according to claim 10, it is characterised in that the virtual screen is located in visible space near near
The position of plane.
12. systems according to claim 10, it is characterised in that the system also includes contact control module：
The contact control module, if the operation for simulated touch is triggered and the ray is deposited with the virtual screen
In intersection point, then coordinate of the message and the corresponding touch point of the intersection point that transmission touch-screen is pressed in touch panel coordinates system
To the touch-screen applications；Continue to send the corresponding touch point of the intersection point in touch panel coordinates system according to intervals
In coordinate, until the operation of simulated touch be stopped and/or the intersection point disappear；Send the message that is released of touch-screen to institute
State touch-screen applications.
13. systems according to claim 10, it is characterised in that the virtual screen is combined into by triangle virtual screen；
The breakpoint detection module, for detecting the ray and the triangle using ray and triangle intersections detection algorithm
The intersecting situation of virtual screen, determines that the ray whether there is intersection point and the intersection point in the void with the virtual screen
Intend the position in screen.
14. a kind of systems that touch-screen applications are realized in virtual screen, it is characterised in that including with lower module：
Touch-screen applications display module, for touch-screen applications to be included in virtual screen；
Collision detection module, for detecting whether ray being sent from hither plane center, extending to far plane center collides
On the virtual screen and position of the point of impingement in the virtual screen；
Point coordinates determining module is touched, the point of impingement is determined for the position according to the point of impingement in the virtual screen
Coordinate of the corresponding touch point in touch panel coordinates system.
15. systems according to claim 14, it is characterised in that the system also includes contact control module：
The contact control module, if the operation of simulated touch is triggered and ray collision is in the virtual screen
On, then coordinate of the message and the corresponding touch point of the point of impingement that transmission touch-screen is pressed in touch panel coordinates system is extremely
The touch-screen applications；Continue to send the corresponding touch point of the point of impingement in touch panel coordinates system according to intervals
In coordinate, until the operation of simulated touch be stopped and/or the point of impingement disappear；The message that transmission touch-screen is released is extremely
The touch-screen applications.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611200815.XA CN106843719B (en) | 2016-12-22 | 2016-12-22 | Method and system for realizing touch screen application in virtual screen and VR (virtual reality) equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611200815.XA CN106843719B (en) | 2016-12-22 | 2016-12-22 | Method and system for realizing touch screen application in virtual screen and VR (virtual reality) equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106843719A true CN106843719A (en) | 2017-06-13 |
| CN106843719B CN106843719B (en) | 2020-09-08 |
Family
ID=59135087
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611200815.XA Active CN106843719B (en) | 2016-12-22 | 2016-12-22 | Method and system for realizing touch screen application in virtual screen and VR (virtual reality) equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106843719B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107179876A (en) * | 2017-06-30 | 2017-09-19 | 吴少乔 | Human-computer interaction device based on virtual reality system |
| CN112068757A (en) * | 2020-08-03 | 2020-12-11 | 北京理工大学 | Target selection method and system for virtual reality |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5876607B1 (en) * | 2015-06-12 | 2016-03-02 | 株式会社コロプラ | Floating graphical user interface |
| CN105511618A (en) * | 2015-12-08 | 2016-04-20 | 北京小鸟看看科技有限公司 | 3D input device, head-mounted device and 3D input method |
| CN105955470A (en) * | 2016-04-26 | 2016-09-21 | 乐视控股（北京）有限公司 | Control method and device of helmet display |
| CN106201207A (en) * | 2016-07-13 | 2016-12-07 | 上海乐相科技有限公司 | A kind of virtual reality exchange method and device |
-
2016
- 2016-12-22 CN CN201611200815.XA patent/CN106843719B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5876607B1 (en) * | 2015-06-12 | 2016-03-02 | 株式会社コロプラ | Floating graphical user interface |
| CN105511618A (en) * | 2015-12-08 | 2016-04-20 | 北京小鸟看看科技有限公司 | 3D input device, head-mounted device and 3D input method |
| CN105955470A (en) * | 2016-04-26 | 2016-09-21 | 乐视控股（北京）有限公司 | Control method and device of helmet display |
| CN106201207A (en) * | 2016-07-13 | 2016-12-07 | 上海乐相科技有限公司 | A kind of virtual reality exchange method and device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107179876A (en) * | 2017-06-30 | 2017-09-19 | 吴少乔 | Human-computer interaction device based on virtual reality system |
| CN112068757A (en) * | 2020-08-03 | 2020-12-11 | 北京理工大学 | Target selection method and system for virtual reality |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106843719B (en) | 2020-09-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20150046831A1 (en) | Method and Apparatus for Unlocking Terminal | |
| CN104866225B (en) | A kind of electronic equipment and its control method with touch display screen | |
| US10318042B2 (en) | Controlling method of foldable screen and electronic device | |
| CN102629164B (en) | A kind of multi-point touch equipment and method for information display and apply processing unit | |
| US20180101298A1 (en) | Graph display apparatus, graph display method and storage medium | |
| CN108829327B (en) | Writing method and device of interactive intelligent equipment | |
| CN106201207B (en) | A kind of virtual reality exchange method and device | |
| CN104423836B (en) | Information processing unit | |
| CN105892831A (en) | Sliding display method and sliding display device of list data of mobile terminal | |
| CN106909297A (en) | A kind of data communication processing method, device and electronic equipment, touch display device | |
| CN108196927A (en) | A kind of mask method, device and system | |
| CN105653071A (en) | Information processing method and electronic device | |
| CN103150170A (en) | Table top generation and operation methods of mobile terminal and corresponding devices thereof | |
| CN109254658A (en) | Tactile feedback method, haptic feedback devices and touch display unit | |
| CN107168541A (en) | The implementation method and device of a kind of input | |
| CN106843719A (en) | Method and system, the VR equipment of touch-screen applications are realized in virtual screen | |
| CN106569708B (en) | Method and terminal for realizing pressing simulation display | |
| CN107734138A (en) | The display methods and device of notification message, computer installation and storage medium | |
| US11144178B2 (en) | Method for providing contents for mobile terminal on the basis of user touch and hold time | |
| CN105849678A (en) | Disambiguation of user intent on a touchscreen keyboard | |
| CN106933397A (en) | Virtual object control method and device | |
| CN105955647A (en) | Method and device used for interface regulation | |
| CN108108107A (en) | Display system | |
| JP6973872B1 (en) | Tablet terminal, control method and control program | |
| CN111444494B (en) | Verification method, electronic device and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |